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Abstract. For a single enzyme or molecular motor operating in an aqueous solution of non-equilibrated 
solute concentrations, a thermodynamic description is developed on the level of an individual trajectory 
of transitions between states. The concept of internal energy, intrinsic entropy and free energy for states 
follows from a microscopic description using one assumption on time-scale separation. A first law energy 
balance then allows the unique identification of the heat dissipated in one transition. Consistency with 
the second law on the ensemble level enforces both stochastic entropy as third contribution to the entropy 
change involved in one transition and the local detailed balance condition for the ratio between forward 
and backward rates for any transition. These results follow without assuming weak coupling between 
the enzyme and the solutes, ideal solution behavior or mass action law kinetics. The present approach 
highlights both the crucial role of the intrinsic entropy of each state and the physically questionable role 
of chemiostats for deriving the first law for molecular motors subject to an external force under realistic 
conditions. 

PACS. 05.70.Ln Nonequilibrium and irreversible thermodynamics - 87.16.Uv Active transport processes 



1 Introduction 

Conformational changes of single enzymes have become 
observable through a variety of methods often summa- 
rized as single molecule techniques Q0I2]. Typically, such 
an enzyme is embedded in an aqueous solution contain- 
ing different solutes at specified concentrations. Such a 
preparation, despite having a well-defined temperature, 
often leads to a non-equilibrium system since the aqueous 
solution is not in equilibrium with respect to chemical re- 
■ actions catalyzed by the enzyme. Moreover, for the case of 
' motor proteins [3||4], time-dependent external forces aris- 
, ing if beads in optical traps are connected via polymeric 
spacers to the enzyme provide a source of non-equilibrium. 
Taking seriously both the single molecule set-up show- 
: ing individual transitions and the thermodynamic descrip- 
tion of the surroundig solution then prompts the question 
whether, and if yes how, the thermodynamic laws can be 
applied to such processes on the single molecule level. Is 
it possible to identify the amount of heat released into (or 
taken up from) the aqueous solution constituting an ef- 
fective heat bath if a molecular motor advances one step? 
And how much entropy is produced in such a single step? 

The conceptual and technical tools required for such 
an approach on the level of individual trajectories have 
been developed under the label of "stochastic energetics" 
[5], "thermodynamics of small systems" [6], or, if entropy 
production is included, "stochastic thermodynamics" [7J, 
recently. The basic idea, indeed, is to formulate, on the 



level of an individual trajectory, both a first law, i.e. an 
energy conserving balance between an appropriately de- 
fined external work, internal energy and dissipated heat 
[5], and to identify entropy production [5]. 

The paradigm for such a trajectory based approach are 
colloidal particles in time-dependent potentials created by 
various forms of laser traps. Several joint studies between 
experiments and theory have illustrated how the thermo- 
dynamic quantities can be extracted from records of the 
fluctuating trajectories of such driven Brownian motion 
[10lfTTl[Tl[T3l[Til[T5] . In a slight generalization, (bio)polymers 
with their internal shape degrees of freedom have been 
subject to a similar analysis some of which directed to 
deduce free energy landscapes from non-equilibrium ex- 
periments [HHTllIllIllinilllllllllS]- In both cases, the 
theoretical description typically is based on Langcvin-typc 
dynamics. 

Molecular motors have also been modelled using Lange- 
vin dynamics in a potential that depends explicitly on the 
current chemical state of the motor [2^, 25 .26.27]. Alter- 
natively, as often used for enzymes, a description based 
on discrete, distinguishable states between which (sudden) 
transitions take place is often more appropriate (28 ,29,30, 
[HlEllMllMllSSllMllSZllMllMllinilll]- In most of these works 
the focus has been on elucidating the cycles involved in the 
action of the motor and on deriving force-velocity curves 
and their dependence on ATP and ADP concentrations. 
A stochastic thermodynamics approach has been applied 
in Rcfs. 32,39 for deriving a fluctuation theorem and in 
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Rcfs. [M1I551IM1I571I55] for the identification of heat on the 
trajectory level. Thermodynamics along a trajectory was 
discussed for a single enzyme in Refs. [42 , 43 ,44] and for 
chemical reaction networks in Refs. [55JHS1H2]- 

The purpose of the present paper is to develop the 
stochastic thermodynamics of single enzymes and molec- 
ular motors afresh and coherently under minimal assump- 
tions thus clearly dissecting conditions that are necessary 
from those which are (too) simplifying but not necessary. 
Since this work deals partially with topics addressed pre- 
viously it is appropriate to point out the main differences 
and new results up front. First, some of the earlier work 
(and even recent ones [35]) does not distinguish carefully 
between internal energy and free energy of a state. En- 
zymes differ in this respect from simple colloidal parti- 
cles which have no relevant internal degrees of freedom. 
Within stochastic thermodynamics the first recognition of 
this aspect seems to have been our discussion of the role 
of degenerate states [12] but a more systematic approach 
starting from a solid microscopic model is appropriate. 
A consequence of the correct treatment is that the heat 
released in one step can no longer be inferred from the 
rates directly as it can in the case of a colloidal parti- 
cle. Moreover, formulated correctly, heat in the stochastic 
thermodynamics approach becomes unique and identical 
to the caloric one thereby remeding a deficiency pointed 
out by Sekimoto [5ll4Ti]. Second, the thermodynamics of 
molecular motors has previously been described using the 
concept of "chemiostats" [34 , 35 , 36l [37ll38] . We show that 
the heat thus identified would require rather unrealistic 
experimental conditions and should, in practice, be re- 
placed by a new expression derived below. Third, in our 
earlier work [4"3"ll4"T] , explicit expressions for the individual 
transition rates based on mass action law kinetics have 
been invoked early on thus effectively restricting the range 
of applicability unnecessarily. In fact, the first law can be 
formulated on the trajectory level without any assump- 
tions on the transition rates. Finally, we now can show 
that the correct identification of entropy production oc- 
curing in one step follows quite naturally from requiring 
consistency with the second law on the ensemble level. In 
particular, this condition leads to both stochastic entropy 
[9] as a necessary third contribution to the entropy change 
associated with one transition and to an expression for 
the ratio of the forward and backward rate known as local 
detailed balance. The latter property is usually either pos- 
tulated or claimed to follow from microreversibility which 
is a concept not so trivially applicable to chemical trans- 
formations under non-equilibrium conditions. 

This paper is organized as follows. In Sect. [5] to set the 
stage, we define thermodynamic notions for the states of 
an enzyme undergoing only conformational changes and 
not yet catalyzing reactions. In Sect. [21 we discuss the 
modifications required if we allow chemical reactions. In 
Scct.U] we apply this formalism to molecular motors. Sect. 
[5] deals with entropy production for all these systems. A 
brief summary and conclusions follows in Sect. [5] In the 
appendix, we discuss the implications of our trajectory- 



based approach for the thermodynamics of time-dependent 
ensembles. 



2 Configurational transitions of a single 
enzyme 

2.1 Solution 

The enzyme will be placed in an aqueous solution which 
consists of a set of {Ni} molecules of type i enclosed in a 
volume V sd a temperature T. The microscopic configura- 
tions, i.e., the micro-states, of this solution (without the 
enzyme yet) are labelled collectively by {£ so1 }. The con- 
figurational energy of the whole solution can be expressed 
by a potential \/ sol (£ so1 ) leading to the probability 

P (r l ) = exp[-/3(V so \e ol ) + F so1 )} (1) 
for each micro state £ so1 with the free energy 

F so1 = -fc B Tln^exp[-/31/ sol (f o1 )]. (2) 

Here ft = is the inverse temperature and fee Boltz- 

mann's constant. The (mean) internal energy of this solu- 
tion is given by 

E so1 = Y^P(Z S ol )l /sol (f ol ) (3) 

and its entropy by 

5 so1 = -Afe J2 p ^ S ln P(£ So1 ) = (^ So1 - F sol )/T- (4) 

All these quantities depend on T, V and {Ni}. Moreover, 
we will assume that this solution is large enough to be 
treated in the thermodynamic limit which implies that 
the chemical potential for species i, 

Hi = d m F BO \ (5) 

becomes a function of T and the concentrations {q} = 
{Ni/V} only. 

2.2 Thermodynamic quantities of states 

To this solution, we add a single enzyme, see Fig. 1. Fol- 
lowing in spirit Hill's classical work [SU], we distinguish 
different (mesoscopic) states of the enzyme such that equi- 
libration among microstates corresponding to the same 
state is fast whereas transitions between these states are 
assumed to be slower and observable. Under these condi- 
tions, we can assign to each state n a free energy F^ nz , an 
internal energy E° nz , and an intrinsic entropy S° nz follow- 
ing in spirit Hill's classical work |50| . 

We denote the microscopic configurational degrees of 
freedom of an enzyme with fixed position of its center of 
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(12) 



Fig. 1. (a) Solution with two types of solutes, (b) Enzyme 
in solution in state m. (c) Enzyme in state n with one solute 
molecule tightly bound, and, consequently one less molecule 
in solution. The dashed line in (b) and (c) reflects the purely 
formal splitting of the total system into the solution and the 
enzyme as indicated in and (|16[) for the free energy of 
state m and state n, respectively. 



mass collectively by {£ cnz }- The full configurational energy 
of the system consisting of enzyme and solution becomes 

ytot^enz £ s °l^ — ysol/£Sol\ _|_ y/^enz £ so1 ) = V t0t (6) 

where V(£ enz , £ so1 ) contains both the interaction within 
the enzyme and the interaction between enzyme and solu- 
tion. We now partition all microstates {£} = {(£ enz , £ so1 )} 
of the combined system enzyme and solution into a set 
of state configurations {C n } such that each microstate £ 
of the combined system occurs in one and only one such 
set C n . For any specific state n, the probability p(^\n) 
of finding an allowed microstate of the combined system 
consisting of enzyme and solution then follows from the 
assumption of fast equilibration as 

p(£\n)=eM-l3(V tot (0-Fn)} (7) 
with (3 = and the constrained free energy in state 

(8) 



~fc B Tln^cxph/3F tot (e)] 



and 



5 r r({c,})^5 n ({^})-5 soi ({^}), 



(13) 

respectively. In the thermodynamic limit of the solution, 
these quantities become independent of system size and 
depend only on the concentrations {ci}. Since we keep T 
and V fixed throughout the paper, we suppress the de- 
pendence on these quantities notationally and often that 
on ({ci}) as well. 

Since both the full quantities as well as the bare solu- 
tion quantities obey the usual relation between free energy, 
internal energy and entropy, it is obvious that 



F c 



TSi 



(14) 



holds as well. So it looks like the full system, enzyme plus 
solution, could be split into two subsystems with additive 
thermodynamic quantities despite the fact that the en- 
zyme is neither a macroscopic object nor that we have as- 
sumed that the interaction between enzyme and solution is 
in any sense small. The caveat, however, is that the quan- 
tities refering to the enzyme (F° nz ,i?° nz and <S^ nz ) will 
depend on the concentrations {ci} which refer primarily 
to properties of the solution. 



2.3 First law 

In the spirit of stochastic thermodynamics, we now formu- 
late a first-law like energy balance for transitions between 
states. Obviously, there is no external work playing any 
role for such a closed system. If the enzyme jumps from 
state m to state n, the change in internal energy 



AE = E„ — E m — E 1 ™ 21 — E n 



(15) 



can be identified with an amount q of heat being released 
into (or, if negative, being taken up from) the surrounding 
heat bath. 



ensuring proper normalization X^ec P(£\ n ) = 1- The (mean) 
internal energy in state n is 



E n = £ p(C\n)V to \0 
and the (intrinsic) entropy becomes as usually 



3 Enzymatic reactions 
fg\ 3.1 Binding of substrate molecules 



b 2^ P(*W = (E n - F n )/T. (10) 

«ec„ 

The thus defined free energy, internal energy and (in- 
trinsic) entropy of each state of the combined system will 
depend on T,V and {Ni}. For a finite range of the in- 
teraction potential F(^ enz ,f oI ), we can indentify the free 
energy, internal energy and intrinsic entropy of the enzyme 
proper with 



For an enzyme, configurational changes often involve the 
binding or release of smaller molecules from the surround- 
ing solution like the nucleotides ATP, ADP or inorganic 
phosphate Pi. For states with such bound molecules, like 
the one shown in Fig. lc, it will be convenient to iden- 
tify the free energy of the state somewhat differently than 
done in (TTTI) . In the case where state n has one A\ molecule 
tightly bound to it, we define 



(11) 



F n (Ni) - F^iNx -l) = F n (N 1 ) + m- F sol (iVi), 

(16) 

where we use (J5J) and drop notationally the dependence on 
the irrelevant species {Ni} with i ^ 1. This definition thus 
means that F% nz is obtained by subtracting from the total 
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free energy F n of the combined system the free energy of a from those which have not for which we will use (|1HI13[) . 



solution containing one less A\ molecule (the bound one). 
The idea behind it is again a conceptual (but not physical) 
splitting of the whole system into the enzyme (plus the 
bound molecule) and the solution possible despite the fact 
that both may interact strongly. 

The advantage of this scheme becomes obvious if we 
consider a binding event conventionally written as 



m + A\ 



(17) 



where upon binding of an A\ molecule a state m trans- 
forms into the state n just discussed, compare Fig. 1 (b) 
and (c). The free energy difference involved in this process 
becomes 



While this distinction of identifying the quantities with 
the superscript "enz" may seem somewhat pedantic for 
pure binding reactions, it becomes mandatory when we 
consider enzymatic reactions. 



3.2 Example: Hydrolysis of ATP 

For a typical example involving an enzymatic reaction con- 
sider binding and subsequent hydrolysis of ATP in a solu- 
tion containing ATP, ADP and Pi, at chemical potentials 
MTjMd, and pp, respectively. The enzyme undergoes a 
transition 



AF 



- Mi H 

I^cnz 



- Ml. 



(F° 

\ 77 



(18) 
(19) 
(20) 



If one changes the concentrations of A\ molecules in the 
solution one would expect that the difference in free ener- 
gies depends on this concentration. Such a concentrations 
dependence becomes obvious through the [i\ term. The 
free energy F° nz defined according to ([To]) will typically 
only weakly depend on concentration since it mainly con- 
tains the interaction between the one bound A\ and the 
enzyme. If we had used the definition (|11[) also for the 
free energy of the enzyme in state n, [i\ would not show 
up explicitly in (|20p . The dominant concentration depen- 
dence of the free energy change would then be hidden in 
the F™ z term. 

In a more general case, if a state n has J^i r iM molecules 
bound to it, we define its free energy as 



K nz ({d}) 



F^dNi-n}) (21) 
5> Ml -F sol ({Aj), (22) 



Likewise, one can identify the entropy and internal energy 
of the enzyme in such a state accordingly as 

Srttci}) = S n ({N t }) - S S °\{N Z - n }) (23) 
= S n ({Ni}) - 5>0r W - S sol ({7V 4 }),(24) 



where we use 
and 



d Ni S so1 = -driii 



(25) 



£5™ ({<*}) = E n m}) - E s °\{Ni - n}) (26) 
= E n ({N i })+ (27) 

+ Y^nOa - Td TlH ) - E so \{Ni}X28) 

i 

So from now on for the precise definition of the free 
energy, internal energy and entropy of a state we need 
to distinguish between states that have solute molecules 
bound to them for which the definition (|2HI28[) will be used 




We have made explicit that in state m an ATP and that in 
state n an ADP and a Pi are tightly bound to the enzyme. 
The overall reaction becomes 



k + ATP ^ k + ADP + Pi. 



(30) 



For simplicity, we have constrained the enzyme to be in 
the same state k (without bound molecules) before and 
after the reaction. The free energy difference for the first 
step involving the binding of the ATP becomes 



F 2 -F 1 = (F™ z - Mt) - F, 



enz 
k ' 



(31) 



where we use (|2Tj) since state m has an ATP bound to it. 
Likewise, the free energy difference upon release of ADP 
and Pi becomes 



F^F^ = Fr~(FT z -^D-^p)- 
Since the overall free energy difference clearly is 
AF = F i -F 1 = fi D + tip - fpp, 



(32) 



(33) 



we obtain for the free energy difference between the two 
intermediate states the expression 

F 3 - F 2 = (F 3 - F 4 ) + (F 4 -F 1 ) + (F 1 - F 2 ) - F™ z - F™ z . 

(34) 

The last line shows the advantage of expressing the free 
energy of the enzyme in terms of definitions (|2ip . Clearly, 
the free energy difference between these two intermediate 
states should not strongly depend on concentrations of 
the solutes, i.e., should not contain terms that depend 
explicitly on their chemical potentials. 



3.3 General case 

For a general case, consider transitions typically written 
as 

v+E r ^^< + E s ^ ( 35 ) 

i i 

where 1 < p < N p labels the possible transitions. Here, 
n~ and n+ denote the states of the enzyme before and 



Udo Seifert: Stochastic thermodynamics of single enzymes and molecular motors 



5 



after the reaction, respectively. Following the scheme just 
applied to the example above, we obtain for the free energy 
difference involved in this transition 



where 



AF P = AFp nz 



P nt 



AF. 



F c 



sol 



denotes the free energy change of the enzyme and 



AFf = Y,{<-r P M^^ p 



(36) 
(37) 

(38) 



denotes the free energy change attributed to the solution 
in this reaction. Note that these relations remain true even 
if the states n~ and np~ have both the same additional 
molecules not showing up in (f35j) bound to them provided 
one then uses for their free energies the definition anal- 
ogously to (|21j) . Likewise, the change in internal energy 
and entropy of the combined system becomes 



AE n 



AE cnz 



AE 



sol 



E e ™ + Ap p - TdrA/ip, 



and 



AS D 



AS] 

gen: 



,- ASp° 



drAp 



(39) 
(40) 



(41) 
(42) 



respectively. 



3.4 First law 

As in the case of pure conformational changes, we now 
want to assign a first law type energy balance to each 
reaction of type p shown in (|35|) . Once an initial state 
is prepared, in the closed system (enzyme plus solution) 
there is obviously no source of external work. Neither docs 
the system perform any work. Hence, the heat released in 
this transition is given by minus the change of internal 
energy of the combined system |39l) 



q p = -AE P = -AE C ™ - Ap p + Td T Ap fi 



(43) 



This relation shows that the enzyme and the solution are 
treated on the same footing since only their combined 
change in internal energy enters. Clearly, since the heat 
is released into the solution acting as a thermal bath, 
the configurational change of the enzyme as well as bind- 
ing and releasing solute molecules contribute to the same 
bath. 



4 Molecular motors 
4.1 First law 

Essentially the same formalism applies to an enzyme act- 
ing as a molecular motor often described by such discrete 



states. Most generally, if the motor undergoes a forward 
transition of type p as in (|35p it may advance a distance 



dp in the direction of the applied force / (or, if / < 0, 
opposite to it). We allow the special cases d p = (pure 



chemical step) or 



(pure mechanical step) 



but do not exclude that both types are involved in one 
transition. For d p ^ 0, the mechanical work 



,,mcch 



(44) 



is applied to (or, if negative, delivered by) the motor. 

We first consider the case that the motor is operating 
in an environment where the concentration of molecules 
like ATP, ADP or P; are initially fixed. Effectively, these 
conditions correspond to a closed system as discussed above 
for an enzymatic reaction. In an almost trivial extension of 
(|43|) the first law for a single transition of type p becomes 



Qp 



,,mcch 



AE P = fdp-AE c p nz -A^p + Td T Afip. (45) 



4.2 Comparison to previous work: "Chemiostats" 



The form (|45|) of the first law with the concomitant identi- 
fication of the heat dissipated in such a transition is origi- 
nal to the present work. It differs from the form discussed 
previously for molecular motors by Baker |31j . and, more 
recently, in particular by Lipowsky and co-workers [34,35, 
36,37,38 . In their work, the first law for a step like in (|35l) 
is formulated (using our notation and sign convention) as 



1p 



,,mcch 



AE c p nz 



Ap p 



where we use the overbar to distinguish their heat 



9p 



TAS 



sol 



(46) 



(47) 



from the present q p . If the heat released in one step is a 
physically meaningful concept, it should be unique. Hence, 
only one expression, either q p or q p , can be the correct one. 

Formally, the two expressions for the heat differ by a 
term involving the entropy change in the solution resulting 
from the reaction. The physical origin of the two different 
forms arises from the fact that in the previous work the en- 
zyme is thought to be coupled to "chemiostats" providing 
and accepting molecules at an energetic cost (or benefit) 
given by their chemical potential. Introducing the notion 
of a chemical work 



chem 



-Ap p 



the first law is then written in the form 



w 



mcch 



chem 



AE c p nz 



Qp- 



(48) 



(49) 



The origin of the difference between the two approaches 
becomes clear by analyzing the operation of chemiostats 
in more detail in the context of whether the concentration 
of the Ai molecules are kept strictly constant or not. This 
distinction has been alluded to in our previous work on en- 
zymatic reactions [43j and biochemical recation networks 
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[47] where the same subtlety arises but it seems appropri- 
ate to provide a more explicit and detailed discussion in 
order to settle this important point. Essentially, one has 
to distinguish two different scenarios. 

Scenario I is the one discussed in the present paper so 
far where we prepare a non-equilibrium state by selecting 
non-equilibrium concentrations {ci} and then let the mo- 
tor run. The first law in the form (|45[) and the correspond- 
ing identification of the heat then seems inevitable. A side 
effect of such a set-up, however, is the fact that strictly 
speaking the concentrations {ci} will (slowly) change in 
a finite system. Insisting on a strictly constant concentra- 
tion will lead us to scenario II. 

In this second scenario, one wants to control the con- 
centrations of these solute molecules throughout the ex- 
periment. Literally speaking, one then has to refill or ex- 
tract certain molecules after a reaction event has taken 
place. Practically, this can obviously not be done in any 
strict manner. Conceptually, however, we can conceive de- 
vices, which are effectively the chemiostats, that "reset" 
the number of solute molecules after each step. Of course, 
such an intervention has to obey a first law as well which 
we formulate for such a reset operation following the re- 
action of type p as 

w re = AE soU c + q re = _ ^sol + q rc^ (5Q) 

where the superscript "re" stands for reset. The change 
in internal energy of the solution AE p ° < le is minus the 
corresponding change in internal energy of the solution, 
i.e., —AE p o1 , when the reaction took place. If this reset 
operation occurs quasistatically, the work w p c spent in it 
is equal to the free energy change of the solution in this 
operation, which is —Ap p , leading to the identification 

q* = -Ap p + AEf = TASf = q p - q p . (51) 

Hence, the heat q p discussed in previous works for 
a single step under chemiostatted conditions physically 
would correspond to the sum of (i) the heat q p dissipated 
in the reaction step and (ii) the heat q p e dissipated in the 
subsequent quasistatic steps when the molecules involved 
in the reaction are fed in and taken out. Note that such 
a procedure makes sure that the concentrations literally 
have not changed at all. 

While this scenario II may be possible conceptually 
it is difficult to envisage a practical experimental imple- 
mentation. It thus seems that for identifying the heat 
the approach taken in the present paper is the physically 
more realistic and relevant one since the motor accepts 
and releases molecules directly from the surrounding so- 
lution with no further feed-back-type interference from 
chemiostats. 



5 Entropy production 
5.1 Motivation 

Naively, one might have expected that with the correct 
identification of both the heat, which should be attributed 



to a change of the entropy of the surrounding heat bath, 
or "medium", via 

AS™ d = q p /T, (52) 

and the intrinsic entropy change of the system AS P as 
given by (|41[l , the total entropy change in one step is given 
by the sum of both, i.e., AS = AS™ cd + AS. 

For a counterexample showing that such a view would 
be too simplistic consider an enzyme with just two states, 
m and n, with E™ z = E° nz and 5™ z > S£ nz . If the en- 
zyme is initially in state m it will at some time jump to 
state n. Such an isoenergetic transition involves no ex- 
changed heat and hence no change in the entropy of the 
medium. Clearly, then the sum of the changes in intrin- 
sic system entropy and medium entropy is negative for 
such a transition. While this is not a problem for a single 
enzyme it becomes one if we consider a whole ensemble 
of enzymes all prepared initially in state m. Likewise, we 
could repeat the experiment with a single enzyme initially 
prepared in state m many times for obtaining an ensemble 
average. In both cases, naively averaging the total entropy 
change as tentatively identified above, we would get on 
average a decrease in total entropy. Such a conclusion vi- 
olates the second law and hence something is missing. We 
now show that we have to add a third contribution to the 
entropy, called stochastic entropy [5], in order to achieve 
a consistent description of entropy changes on the level 
of transitions along an individual trajectory. This concept 
necessarily requires an ensemble description from which 
the individual trajectories are taken. 

On the ensemble level, entropy production in (bioche- 
mical reaction networks has been investigated for quite 
some time using master equation [50115 Ilf52ll3?ll5^] . The 
main point in the following will not be to repeat this anal- 
ysis but rather to use consistency with the second law 
on the ensemble level together with the insight into the 
first law derived above for a complete identification of the 
entropy production to be associated with an individual 
transition on the trajectory level. 

5.2 Ensemble 

In the course of time, the enzyme will jump between dif- 
ferent states. The jump times will be stochastic since there 
is only a certain probability that a reaction of type (|35l) 
takes place if the enzyme is in the state n~ corresponding 
to the left hand side of ([551) . A trajectory of the enzyme 
can then be characterized by the sequence of jump times 
{tj} and the sequence of reactions {p*/} where Pj denotes 
the corresponding reactions and <?j = ± characterizes the 
direction in which the reaction takes place, see Fig. 2 for 
an example based on the scheme ([2T)|) . 

An ensemble is defined by specifying (i) the initial 
probability p n (0) for finding the enzyme in state n and 
(ii) the set of rates with which the reactions ([55)1 takes 
place in either direction. Both inputs will then determine 
the probability p n (t) to find the enzyme in state n at time 
t. Averages with respect to such an ensemble will be de- 
noted by (...). 
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Fig. 2. Two trajectories A (dashed line) and B (full line) for 
an enzyme undergoing the scheme (|29|) with the reactions (1) 
k + ATP =f± 77i, (2) m ^ n, and (3) n ^ k + ADP + P l . For 
trajectory A, the three transitions are all in forward direction 
with pj — j and Oj = +1 for j = 1,2,3 at jump times tf. 
Trajectory B exhibits five transitions at times tf with pi — 
p2 = pz = 1,P4 = 2 and ps = 3 with one backward step 



(0"2 



T) and all other <r; 



5.3 Entropy production in one step 

As explained above, naively adding the entropy change of 
the medium and the intrinsic one of the system will not 
necessarily lead to an on average non-negative entropy 
production. Therefore, we tentatively write the total en- 
tropy change occuring in a forward transition of type f|35[) 
as 



AS P ot (t) = AS 



mcd 



AS P + As p (t) 



(53) 



where the last term is the one still to be determined. The 
reason for introducing an cxplicite time-dependence will 
become clear below. The corresponding value of the total 
entropy change involved in a backward transition would 
be — ASp 0t (t). As an essential requirement, we impose the 
condition that the average total entropy production rate 
is non-negative, i.e. that 

< (S tot W> = £>«,-(*)< - Pn+p {t)w-]ASf\t) (54) 
p 

where here and in the following the dot denotes a time- 
derivative, i.e., a rate. The explicit expression for this av- 
erage arises from exploiting the fact that with probability 
p n - (t) the enzyme is in state n~ allowing at time t the 
reaction p to take place in forward direction with rate 
wj. Likewise, the enzyme is with probability p n +(t) in 

the state allowing the reaction to proceed in backward 
direction. 

Now suppose that we knew the rates wp^ and were 
looking for AS P ot (t) as a function of P n -(t),p n +(t) and 

these rates. Since the inequality ((54)) has to be respected 
for any p n {t), it looks inevitable that each individual term 
in this sum has to be non- negative, i.e., 



°<b>«7 1 



■p nt w-]ASf 



(y-x)AS t p° t (x,y) (55) 



which defines the abbreviations x and y and where we 
suppress the t-dependence notationally. The yet unknown 
function ASp 0t has dimension of entropy, i.e., we can write 



ASl 



kBf{x,y) 



(56) 



Since the function f(x,y) is dimcnsionless, it can depend 
only on a dimensionless variable, i.e. f{x,y) = g(y/x) = 
g(z). Finally, the requirement that interchanging forward 
and backward directions of the reaction p, which amounts 
to interchanging x and y, corresponds to a sign change in 
the entropy imposes the condition 



g(z) = -g(l/z). 



(57) 



Up to an overall amplitude c, the solution of this func- 
tional equation is unique and given by g(z) = chxz. Choos- 
ing c = 1 which a posteriori will guarantee consistency 
with known special cases, we thus obtain the expression 



AS t ; t (t) = k B 



In- 



■ (t)w 



(58) 



for the total entropy change induced by a forward tran- 
sition p. By separating the time-dependent part from the 
time-independent one and by comparing with (|53|) , we can 
now identify both (i) the missing piece in the total entropy 
change in one transition as 



As p {t) =-k B \n 



(59) 



and (ii) a consistency relation between the yet unknown 
rates and the previously defined entropy change of medium 
and system given by 



AS P = ks In ■ 



w 



(60) 



Both identification make sense as we will show in the next 
two subsections. 



5.4 Stochastic entropy 

Quite generally, in a time-dependent ensemble specified 
by probabilities p n (t) stochastic entropy of the system has 
been defined as [5] 



?(t) = -k B lnp n{t) (t) 



(61) 



along any individual trajectory n(t) taken from the spec- 
ified ensemble. Hence, if a transition of type (|55|) takes 
place at time t, the full entropy change of the system 
AS s p ys (t) consists of the change in stochastic entropy ([59"]) 
and that in intrinsic entropy AS p . Explicitly, one obtains 



ASl ys (t) = A S p(t) + ASp 



~kn In 



AS P . (62) 
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Keeping the time argument is crucial since in a time- 
dependent ensemble the same transition leads to a dif- 
ferent contribution depending on when it takes place. 

Finally, adding the concomitant change in entropy of 
the heat bath Z\S™ ed = q p /T, we obtain for the total en- 
tropy change associated with this transition the expression 
which can also be written as AS tot (t) = AS™ cd + 
AS sys (t). Note that in an equilibrium ensemble, where 
global detailed balance applies, i.e., for p n (t) = and 
p^Lw+ = p c ^\_w~ , for each jump the contribution to sys- 
tem entropy and medium entropy exactly compensate each 
other so that the total entropy remains strictly constant 
along any individual trajectory. 



5.5 Rates and local detailed balance 

The consistency relation derived above in (|60p between 
the ratio of the rates and the sum of medium and system 
entropy change can be reformulated as 

^ = cxp[-/3AF p ] = cxph/3(AF; nz + Afx p )], (63) 

for the case of an enzymatic reaction and as 

= cxph/?^;" 2 + An P - < och )] , (64) 

w p 

in the case of a motor protein where this transition in- 
volves external work, respectively. Here, we have used (|52l) 
and the first law in the form (|43]) and (|45j) , respectively. 
For molecular motors, the additional exponential factors 
express the contribution of an applied force. In both cases, 
all quantities depend on the concentrations {ci}. 

Both relations for the ratio of the rates of forward reac- 
tion to backward reaction are well known under the notion 
of "local detailed balance" . In the present work, we have 
shown that the rates have to obey this relation in order to 
get positive total entropy production in a time-dependent 
ensemble. 



5.6 Dynamical formulation of the first law 

It is instructive to reformulate the two variants of the first 
law discussed above for molecular motors in terms of these 
rates. For a closed system, prepared with non-equilibrium 
conditions, the heat released in this transition becomes 

q p =T(k B ]n^-AS p ) , (65) 
V Wp J 

irrespective of whether external mechanical work is in- 
volved or not. This expression shows that due to the pres- 
ence of the intrinsic entropy change AS P the heat dissi- 
pated in one transition cannot be infered by just measur- 
ing the ratio of the rates. 



For the alternative case of chemiostats with the explicit 
rcfeeding and taking out of used and produced solutes one 
gets 

q P = T(k B \n^-AS c ™y (66) 

For molecular motors often the case of a full cycle is 
discussed after which the enzyme comes back to its ini- 
tial internal state. Note that for the scenario involving 
the chemiostats, the heat q dissipated along the cycle can 
then be expressed by just the logarithm of the ratio of 
the product of forward and backward rates along the cy- 
cle. For the physically more realistic heat q, one has to 
correct for the entropy change in the solution in order to 
determine the heat from the product of the rates along a 
cycle. 

5.7 Fluctuation theorems 

So far, we have analyzed the changes in thermodynamic 
quantities caused by an individual transition. By summing 
up the contributions from all transitions pJ J happening 
during a time interval U < t < tf and taking into account 
a possible change in stochastic entropy s(t) due to an ex- 
plicit time-dependence in p n (t) while the system stays in 
one state, one obtains the total entropy change along a 
trajectory during this time interval as 

AS tot = k B V In + s(t f ) - s(ti). (67) 

This quantity obeys a relation called the integral fluctua- 
tion theorem for entropy production [9] 

(exp[- AS tot /k B ]) = 1, (68) 

where the average (...) is over many trajectories taken from 
any well-defined initial ensemble characterized by p n {ti) 
and running for an arbitrary but fixed time interval tf — ti. 
From this integral relation one gets easily the second-law 
like statement on the mean total entropy production 

(AS tot ) > 0. (69) 

In the approach promoted in this paper, rather than "de- 
riving" the latter relation from the integral fluctuation 
theorem, we have used it as an essential consistency re- 
quirement for (i) arguing that stochastic entropy is a cru- 
cial contribution to the entropy change occuring in an 
individual transition and (ii) showing that rates obeying 
the local detailed balance relations (|63l64p are required by 
thermodynamic consistency. 

For a non-equilibrium steady state where p n (t) = p n 
is independent of time, one has the detailed fluctuation 
theorem 

p(-AS tot )/ P {AS tot ) = exp(-AS tot /k B ) (70) 

for the probability distribution p(AS tot ) to observe a cer- 
tain total entropy production valid for any time interval 
in this non-equilibrium steady state [5]. 
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6 Conclusions 

The present analysis is supposed to reveal more clearly 
than previous work both the structural coherence and 
some finer issues of the stochastic thermodynamics of sin- 
gle enzymes and molecular motors. We first summarize 
the main assumptions and consequences of this approach. 

On the state level, internal energy, intrinsic entropy 
and free energy follow from an underlying microscopic 
model if one assumes a time-scale separation between tran- 
sitions within each state and the slower and observable 
transitions between these states. It is not necessary to as- 
sume weak interactions between enzyme and solutes. The 
first law with a concomitant identification of heat dissi- 
pated in one transition then follows almost trivially. This 
form of the first law is in disagreement with formulations 
for motor proteins where chemiostats have been invoked 
as source of "chemical work". We have argued that their 
operation is somewhat artificial as then is the correspond- 
ing identification of heat. 

Entropy production on the level of an individual tran- 
sition still requires the notion of an ensemble. Enforcing 
the second law for any time-dependent ensemble then nec- 
essarily leads to both stochastic entropy as crucial contri- 
bution to the total entropy change and the local detailed 
balance condition for the rates. No assumption, however, 
on the form of the individual forward and backward rates 
are necessary. Hence, throughout the paper there was no 
need to show ever rates and the master equation for the 
probabilities p n {t) explicitly. Moreover, the present analy- 
sis shows that the "inverse" problem is ill-posed: Given a 
master equation with transition rates {w mn } (and, hence, 
a unique stationary state {p^}), it is, in general, not possi- 
ble to assign uniquely an internal energy level E n , intrinsic 
entropy S n and free energy F n to a state. In particular, 
the choice E n = —fee Tin p a n suggested recently [48] (like 
its obvious ramification F n = —k^Thip s n ), while formally 
possible, looks arbitrary and is, potentially, in conflict with 
an underlying specific microscopic model. If just transition 
rates between states are given, only a second law like state- 
ment about total entropy production follows. Any further 
splitting up of the entropy production into environment 
and system let alone a definite form of the first law in- 
volving internal energy and exchanged heat is arbitrary 
without further physical input. 

The main difference of enzymes and motors compared 
to colloidal systems, which have no relevant hidden inter- 
nal degrees of freedom, is the crucial role the intrinsic en- 
tropy of the states play. The latter shows up if the first law 
is expressed dynamically through the rates. It prevents a 
direct inference of the dissipated heat from a measurement 
of the ratio of the rates even on the level of a complete 
cycle. In the total entropy production, on the other hand, 
the intrinsic entropy does not appear explicitly. Therefore, 
the fluctuation theorems hold true unmodified. A conse- 
quence, of course, is that these theorems cannot be used to 
"disentangle" the dissipated heat from the entropy change 
occuring in the solution. 

Throughout the paper, we have assumed stationary 
non-equilibrium conditions which implies that the rates 



are time-independent. In fact, the results for the individ- 
ual transitions hold true even if the rates become time- 
dependent either since the concentrations of the solutes 
are externally modulated (or, in a finite system, depleted 
due to the action of the enzymes) or since the forces ap- 
plied to motor proteins are time-dependent. However, un- 
der such time-dependent external conditions the thermo- 
dynamic state variables E n , S n and F n can become time- 
dependent as well. In consequence, both the quantities ap- 
pearing in the first law and entropy production can pick 
up contributions even while the enzyme remains in the 
same state. 

Finally, with the conceptual basis thus solidified, these 
thermodynamic notions should now be applied to data 
from single enzyme experiments. A very promising molecule 
seems to the Fl-ATPase for which the first experimental 
studies using such concepts have just appeared [551156] . 

7 Appendix: Non-equilibrium ensemble 
thermodynamics 

The main intention of the approach discussed in this paper 
has been the identification of thermodynamic quantities 
not on the ensemble level but for a single enzyme along its 
fluctuating trajectory taken from a well-defined ensemble. 
For completeness and future reference, we briefly present 
the consequences of our thermodynamically consistent ap- 
proach for time-dependent averages. 

Quite generally, once for each state n of a system an 
internal energy E n , an intrinsic entropy S n , and a free 
energy F n are identified from a more microscopic model, 
the ensemble average of the internal energy becomes 

£{t) = (E(t))= Y,Pn{t)E n . (71) 

n 

The appropriate ensemble averaged entropy of the system 
is given by 

S{t)=J2Pn(t)[Sn + S n (t)], (72) 
n 

with s n (t) = — &Blnp n (t). A "dynamical free energy" on 
the ensemble level then follows from the usual thermody- 
namic relation as 

F(t)=£(t)-TS(t)=Y,Pn(t)[F n -Ts n (t)]. (73) 

n 

Note that both quantities, S(t) and ^(t), cannot be ob- 
tained by simply averaging over the state variable S„ or 
F n as it is possible for the internal energy. The expression 
s n (t) arising from stochastic entropy in the square brack- 
ets in ([72"]) and ([75]) is rather ensemble dependent and thus 
not a genuine state variable. 

For a consistency check of these ensemble expressions, 
consider an equilibrium ensemble. Then the probability to 
find the system in any microstate £ is given by 

p c ^=cxp[-/3(V/ tot (£)- J- cq )]- (74) 
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with the equilibrium free energy 

= -k B T In oM-PV tot (0] ■ (75) 
6 

for the total system consisting of enzyme including the 
surrounding solution. Likewise, one has for the ensemble 
internal energy 

£ eq = $> e W tot (0 (76) 

s 

and the ensemble system entropy 

S cq = -k B ^P Cq (0 lnp cq (C) = (£ cq - F cq )/T. (77) 
t 

It is easily checked that the time-dependent quantities ([711 
I73|) agree with these equilibrium ensemble quantities, if 
p n {t) in (|7HI73[) becomes the equilibrium probability 

p? = exp[-!3(F n -F*)]. (78) 

with F n as previously defined in ©. 

For the rate of change of the internal energy of the sys- 
tem, i.e., here the enzyme or motor plus the surrounding 
solution, one obtains 

£W = H(Pn-(tH -Pn+(tH) AE P- (79) 
P 

This expression enters the rate formulation of the first law 
on the ensemble level as given by 

W moch {t) = Q(t) +£(t) (80) 

with 

W™ ch (t) = £(p n _ {t)w+ p n{ {t)w-)v%** (81) 
p 

as the ensemble averaged work rate. The heat dissipation 
rate on the ensemble level thus becomes 

Q(t) = X>np (*H "P„+(*K)«P- (82) 

p 

Likewise, for the full entropy change of the system, one 
obtains 

S(t) = (*)< ~P nt (t)w;)AS s / s (t), (83) 

p 

with ASp ys (t) from ([61?]) and for the corresponding change 
in free energy 

F{t) = £{t) - TS{t) (84) 

= E(Pn,-(*X-P«+(*K")x (85) 
p 

x (Z\£ p -TA^ ys (t)). (86) 

Note that if no external work is applied, the thus defined 
free energy dissipation rate is exactly given by (-T) times 
the total entropy production rate (|54|). 
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